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KONSTRUKTYVAUS DERINIMO 

PASIEKIMAS: 
PIRMENYBESTUDIJy REZULTATAMS 


ACHIEVING CONSTRUCTIVE 
ALIGNMENT: 

PUTTING OUTCOMES FIRST 


SANTRAUKA 

Sis straipsnis grindziamas tyrimais jrodyta prielaida, kad pro- 
jektuoti studijq turinj’ studijq rezultatq pagrindu yra naudinga 
ne tik studentams, bet ir destytojams. Pripazjstant, kad bu- 
tina atsizvelgti j tai, jog studijq rezultatq panaudojimas tarn 
tikru laipsniu gali varzyti studentq minties originalumq ir kri- 
tinj mqstymq, siame straipsnyje pristatomi svarbiausi studijq 
turinio reformos jvertinimo rezultatai siekiant parengti reko- 
mendacijas, kaip turetq buti formuluojami studijq rezultatai ir 
kaip jie galetq geriausiai padeti destytojams ugdyti minetus 
studentq bruozus. 

PAGRINDINig SAVOKg APIBREZIMAI 

• Aukstasis mokslas - studijavimas ir destymas universite- 
tuose pagal UNESCO instituto ISCED-5 statistikos lygmenj ar 
auksciau. 

• Igudis - gebejimas kq nors atlikti. 

• jvertinimas - sprendimq priemimas kriterijq pagrindu. 

• Kompetencija - turimas jgudis (gebejimas kq nors atlikti) ar 
zinios (informacija apie kq nors). Remiantis su Europos Sq- 
jungos Bolonijos procesu susijusio Tuningo proceso (Deusto 
universitetas, 2006b) dokumentais, kompetencija yra studen- 
tq jvaldyti gebejimai ir zinios, jgyti pasiekus tiksliai apibreztus 
studijq rezultatus. 

• Konstruktyvus derinimas - vertinimo, destymo strategijq ir 
studijq rezultatq suderinimas studijq dalyko programoje. 

• Kritinis mqstymas - gebejimas savarankiskai vykdyti ty- 
rimq ir remiantis siuo tyrimu priimti protingus (pagrjstus) 
sprendimus. 

• „Nebylios" zinios - giliai pasqmoneje esancios ismoktos zi- 
nios, veikiancios kaip instinktas. 

• Rezultatais pagrjstas studijq turinys - studijq programos spe- 
cifikacija, nusakoma siekiamq pokyciq studento elgsenoje 
sqvokomis (Pastaba. Visa sqvoka studijq rezultatais pagrjstas 
studijq turinys retai vartojama kalboje). 

• Studijavimas - ziniq ir gebejimq ismokimas per patirtj, prak- 
tikq, tyrimus ar destymq. 

• Studijq galutiniai tiksiai - bendroji sqvoka nusakanti formaliq 
studijq siekiamus rezultatus; si sqvoka apima studijq rezulta- 
tus ir studijq uzdavinius. 

1 Siame straipsnyje pagrinde kalbama apie studijq dalyko studijq tu- 
rinio projektavimq 


ABSTRACT 

This pa per starts from the premise that using learning outcomes 
to organise the curriculum 1 has been demonstrated to be ben- 
eficial to both students and teachers. Accepting, however, that 
there are legitimate concerns over the extent to which the use 
of learning outcomes can inhibit originality and critical think- 
ing of students, this paper uses the results of the evaluation of 
a major curriculum reform to derive guidelines on the formula- 
tion of learning outcomes and on how best they can be used by 
teachers to foster these mentioned attributes in students. 

DEFINITION OF KEYWORDS 

• Higher Education - university level learning and teaching con- 
ducted at UNESCO's Institute of Statistics Level ISCED-5 or above 
(UNESCO undated). 

• Skill - the ability to do something. 

• Evaluation - making judgements against criteria. 

• Competency - skill (the ability to do something) or knowled- 
ge (information about something) possessed by someone. In 
the European Union's Bologna process related Tuning Project 
(Deusto University 2006b), the skills or knowledge students 
possess once they have achieved specified learning outcomes. 

• Constructive alignment - having coherence between asses- 
sment, teaching strategies and intended learning outcomes in 
an educational programme. 

• Critical thinking - the ability to carry out self-directed inquiry 
and make reasoned judgements on the results of this inquiry. 

• Tacit knowledge - knowledge that is so deeply embedded as 
to be, effectively, unconscious and which manifests itself as a 
learned instinct. 

• Outcomes-based curriculum - a specification for a programme 
of learning that is expressed in terms of desired changes in stu- 
dent behaviour. (Note: the long-form learning outcomes-based 
curriculum is rarely used in practice.) 

• Learning - the acquisition of knowledge or skills through expe- 
rience, practice, study or being taught. 

• Learning goals - a generic term for the intended results of for- 
mal learning; this term encompasses both learning outcomes 
and learning objectives. 

• Learning outcomes - statements which describe what a stu- 
dent should be able to do at the end of a course or program- 


1 For this article curriculum relates to the organisation of the subject 
matter 
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• Studijq rezultatai - teiginiai, apimantys tai, kq studentai tu- 
retq sugebeti padaryti isklaus^ studijq dalykq ar baigq studijq 
program^. Si sqvoka daznai nusakoma trumpiau - rezultatai. 

• Studijq uzdaviniai - teiginiai, apimantys tai, kq studentai tu- 
retq gebeti atlikti pamokos, seminaro ar paskaitos pabaigoje. 
Si sqvoka daznai nusakoma trumpiau - uzdaviniai. 

• Vertinimas - is anksto apgalvotas atviras studijq veiklos ma- 
tavimas siekiant paskleisti informacijq placiau, o ne vien pa- 
naudoti artimiausios interaktyvios studijq situacijos tikslams. 

• Vertintojai - vertinimq atliekantys asmenys. 

JVADAS 

Dar palyginti neseniai daugelio universitetq studijq da- 
lykq aprasai, apimdavo tik studijq turinj, kurj studentai 
tures jsisavinti. Buvo akcentuojama destytojo veikla, o 
studijq tikslai buvo nusakomi per turinj, kurj destytojas 
tures perteikti studentams ir kurj siems reikes jsisavinti. 

Naujesnis j studentq orientuotas universiteto stu- 
dijq modelis studijq proceso centru laiko studentq. 
Vienas svarbiausiq sio modelio ypatumq yra studijq 
dalyko apibudinimas pagal tai, kq studentai turetq ge- 
beti atlikti isklaus^ tq studijq dalykq. Tai nusakantys 
teiginiai vadinami numatomais studijq rezultatais, o 
trumpiau - rezultatais. 

Reikia pazymeti, kad jvairus autoriai vartoja skirtin- 
gus terminus - studijq rezultatai ir studijq uzdaviniai - 
tiems patiems dalykams nusakyti, todel kyla visokiq ne- 
aiskumq. Sio straipsnio autorius remiasi D'Andrea (2003) 
tradicija ir vartoja minetas sqvokas auksciau nusakyta 
prasme. Deja, tai tik is dalies issklaido neaiskumus, nes 
pateikti apibrezimai susij^ su kontekstu, kuriame „sie- 
kiama elgsenos aprasymo" t. y. rezultatas ar uzdavinys 
dazniau suprantamas kaip integrali paties studijq daly- 
ko apraso kokybe.Taigi, kas viename kontekste gali buti 
rezultatas, kitame kontekste gali tapti uzdaviniu.Taciau 
bet kokiq studijq kontekste uzdavinys apims mazesnio 
mqsto veikimq ar mazesnj ziniq kiekj, nei rezultatas. 

Europos Sqjungos Tuningo projekte (Deusto uni- 
versitetas, 2006a) isskirtos dvi sqvokos - kompetencijos 
(angl. competences, kitas rasybos variantas - competen- 
cies) ir rezultatai. Tuningo modelyje studijq programos 
ir studijq dalykai apibudinti rezultatq dimensija, o siuos 
rezultatus pasiek^ studentai laikomi turinciais sias kom- 
petencijas (issamesn^ diskusijq apie studijq rezultatq kil- 
mf ir kitus apibrezimus galima rasti internetiniame The 
Scottish Executive puslapyje - Scottish Executive, 2006) 

Daugelyje tyrimq prieinama isvados, kad gerai 
sumodeliuoti studijq rezultatai padeda studentams 
efektyviai mokytis (Biggs, 2003; Rust ir kiti, 2003; Spa- 
dy, 1 994; Spady, 1 988). Problema ta, kad sqvoka „efek- 
tyviai mokytis" yra gincytina, nes labai daznai ji reiskia 
tik didesn^ sekm^ per egzaminus ar kokiq kitq vertina- 
mq veiklq, o ne ilgalaik^ siekiamq naudq studentui ar 


me of learning. This term is frequently used in the short-form 
outcomes. 

• Learning objectives- statements which describe what a student 
should be able to do at the end of a lesson, workshop or lecture. 
This term is frequently used in the short-form objectives. 

• Assessment- the deliberate and overt measurement of educa- 
tional performance in order to provide information for purpo- 
ses beyond the immediate interactive learning situation (Bro- 
adfoot1996: 6). 

• Assessors - those who conduct assessment. 

INTRODUCTION 

Until comparatively recently, most university courses 
were described in terms of the content that would be 
covered. The focus was on what the teacher did, while 
learning goals were expressed in terms of the content 
which the teacher would present to the students and 
which they had to learn. 

The newer learner-centred model of the university 
curriculum, however, places the student at the heart 
of educational process. One of the key features of this 
model is that courses are described in terms of what it is 
that the students should be able to do on exit. The state- 
ments which describe this are called intended learning 
outcomes or outcomes for short. 

It is worth noting at this point that there is some 
confusion in the literature over the terms learning out- 
comes and learning objectives - to the point where many 
authors use the terms inter-changeably. This author 
follows the practice of DAndrea (2003) in using these 
terms as defined above. Unfortunately, this only partly 
clears up the confusion because the definitions given 
relate to the context in which the 'description of desired 
behaviour' (i.e. the outcome or objective) is used rather 
than some integral quality of the description itself. Thus, 
what is an outcome in one context can be an objective 
in another. Within any given educational context, how- 
ever, an objective will describe a smaller action or small- 
er quantity of knowledge than an outcome. 

The European Union's Tuning Project (Deusto Uni- 
versity 2006a) distinguishes between competences (an 
alternative spelling of 'competencies') and outcomes. 
In the Tuning model, programmes and courses have 
outcomes while the students, once they have achieved 
these outcomes, are said to have competences (for a 
fuller discussion on the origin of the use of outcomes in 
education together with further definitions, readers are 
recommended to view the relevant pages of The Scot- 
tish Executive website Scottish Executive 2006). 

The proposition that well-constructed learning out- 
comes enable students to learn more effectively is well 
supported in the literature (Biggs 2003, Rust et al 2003, 
Spady 1 994, Spady 1 988). The problem is that "learning 


12 


AUKSTOJO MOKSLO KOKYBE • THE QUALITY OF HIGHER EDUCATION ■ 2006/3 


visuomenei. Net pripazjstant, jog yra pagrindo manyti, 
kad pasinaudojimas studijg rezultatais gali paskatinti 
gilqjj mokymqsi (McMahon ir O'Riordan, 2006; McMa- 
hon, 2006a, 2005; Biggs, 2003; Rust ir kiti, 2003), vis del 
to islieka svarbus svarstytinas klausimas, ar studijg re- 
zultatg apibrezimas neuzslopins destytojo ir studento 
kurybiskumo ir is to kylancio potencialaus studijg gi- 
lumo ir platumo bei visg svarbiausio dalyko - minties 
kritiskumo (Rees, 2004; Harden, 2002; Hussey ir Smith, 
2002; Ecclestone, 1994; Stenhouse, 1986). Todel svarbu 
kuo greiciau istirti, ar studijg rezultatai gali buti taikomi 
studento kritiniam mgstymui skatinti ir kaip jais turi buti 
pasinaudota Siam tikslui pasiekti. Kritinis mgstymas sie- 
jamas su dviem auksciausiais lygmenimis Bloom nusta- 
tytoje mokymosi lygmeng klasifikacijoje (Anderson et al 
2001): jvertinimu (gebejimu priimti sprendimus kriterijg 
ir standartg pagrindu) ir sinteze bei kurybingumu (ge- 
bejimu pasiekti naujg supratimo laipsnj ir aptikti naujas 
faktg sgsajas). 

Remiantis MacMahon (2006a, 2006b, 20005), McMa- 
hon ir O'Riordan (2006) tyrimais bei Dubline atlikto stu- 
dijg rezultatg panaudojimo tyrimo isvadomis siame 
straipsnyje siekiama dviejg tikslg: 

1. Nustatyti keturias rezultatus nusakancias kate- 
gorijas ir remiantis Dublino patirtimi iskelti teiginj, kad 
kritinis mqstymas geriausiai ugdosi tuo atveju, kai rezul- 
tatai nusakomi apytikriai, buna susij^ su kontekstu ir yra 
diskutuotini. 

2. Pasinaudojant rezultatais parengti rekomenda- 
cijas praktiniam darbui ir jo tobulinimui. Ypac svarbu 
konstruktyviai derinti studijg rezultatus, studentg pa- 
siekimg vertinimg ir destymo metodg. 


1 

PEREJIMO PRIE REZULTATAIS PAGRJSTO 
STUDIJy TURINIO 1VERTINIMO VIENAME IS 
SVARBIAUSiy EUROPOS UNIVERSITETy 

Neseniai atlikto tyrimo Dublino universitete (Dublin 
UCD) rezultatai parode, kad skatinant kritinio mgstymo 
tobulinimg, studijg rezultatai turetg tapti bendraisiais 
studentg pasiekimg vertinimo rodikliais, kurig pagrindu 
universitetg vertintojai turetg priimti sprendimus apie 
tarn tikro ismokimo lygmens pasiekimo patvirtinimg 
(placiau zr. McMahon ir O'Riordan, 2006). Tyrimu taip 
pat nustatyta, kad labai svarbu: 

1 . Apriboti studijg rezultatg skaicig, kuris yra panau- 
dojamas bet kuriame konkreciame studijg modulyje; 

2. Uztikrinti, kad studijg rezultatai nebutg apibudi- 
nami pernelyg smulkmeniska (tiksliai aprasancia irjsak- 
mia) kalba; 

3. Pasiekti, kad destymo strategijos ir studentg pa- 
siekimg vertinimo tvarka tiksliai atitiktg apibreztus stu- 
dijg rezultatus. 


more effectively" is a contested concept all too often 
taken to mean nothing more than greater success in ex- 
ams or other assessed activities, regardless of long-term 
benefit to the learner or society. Even allowing for the 
evidence that the use of learning outcomes can encour- 
age deep learning (McMahon & O'Riordan 2006, Mc- 
Mahon 2006a, 2005, Biggs 2003, Rust et al 2003), there 
remains considerable debate over the extent to which 
the act of defining learning outcomes will limit both 
teacher and student creativity and, hence, the potential 
depth and breadth of learning and, in particular, critical- 
ity of thought. (Rees 2004, Harden 2002, Hussey & Smith 
2002, Ecclestone 1994, Stenhouse 1986). Consequently, 
there remains a pressing need to investigate if and how 
outcomes can be used to foster critical thinking. This is 
the kind of thinking that is found in the two top levels 
of Bloom's revised taxonomy of learning (Anderson et al 
2001), namely, "evaluation" (the ability to make judge- 
ments using criteria and standards) and "synthesis / 
creation" (the ability to achieve a new understanding by 
finding new connections between facts). 

Building on earlier reports McMahon 2006a, 2006b, 
20005; McMahon and O'Riordan 2006), this paper uses 
the results of a study of the use of outcomes by UCD, 
Dublin to do two things: 

1 . Identify four categories of outcome and suggest, 
on the basis of the Dublin experience, that critical think- 
ing is best fostered by outcomes which are imprecise, 
context-related and contestable. 

2. Derive guidelines for best practice in developing 
and using outcomes. In particular, it identifies the im- 
portance of ensuring constructive alignment between 
outcomes, assessment and teaching method. 


1 

AN EVALUATION OF A SHIFTTO AN 
OUTCOMES-BASED CURRICULUM BY A 
MAJOR EUROPEAN UNIVERSITY 

Recent research at UCD Dublin suggests that in order 
to promote the development of critical thinking, out- 
comes should be regarded as general performance indi- 
cators that guide the judgement of academic assessors 
rather than as definitive threshold statements (For more 
details see: McMahon & O'Riordan 2006). The same re- 
search also suggests the importance of: 

1. Limiting the number of outcomes used in any 
given module. 

2. Ensuring that the wording of outcomes is not 
over-prescriptive. 

3. Ensuring that both teaching strategies and 
the assessment regime are explicitly aligned to the 
outcomes. 

This involves abandoning the twin fallacies that: 
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Tokiu budu galima isvengti poros klaidingq jsitiki- 
nimLi, kad: 

1. Studentai privalo pasiekti visus studijq rezulta- 
tus,jei nori islaikyti egzaminus; 

2. Studijg rezultatuose turi buti nurodyti minima- 
lus reikalavimai, kurie patvirtintq, kad gebejimai, kom- 
petencijos ar zinios buvo jgyti. 

Taciau sie jsitikinimai siekiant aukstojo mokslo 
laipsnio yra klaidingi, nes vienas is universitetiniq pro- 
gramq tikslq yra uztikrinti, kad baigusieji studijq pro- 
gramas suvoktq, jog profesionalumq tam tikroje srityje 
rodancios zinios ir kompetencijos nuolat kinta. Del sios 
priezasties profesionalumo palaikymas tiesiogiai susi- 
j^s su mokymusi visq gyvenimq (McMahon, 2006b). 

UCD tyrime nustatyta, kad studijg dalyko progra- 
mose gali buti ketveriopo pobudzio studijg rezultatai: 

1. Tikslus konteksto atzvilgiu ir palyginti negincyti- 
ni gebejimai ar zinios, pavyzdziui: Apibudinkite herbici- 
de bei pesticidq chemines savybes ir jq veikimo bud us bei 
jstatyminq sip medziagq naudojimo baz%. 

2. Savo prigimtimi negalintys buti tiksliai suformu- 
luoti (daznai del tos priezasties, kad jie susij^ su dina- 
miskomis, o ne statiskomis situacijomis), pavyzdziui: 
Apibudinkite efektyvios segmentacijos, krypties ir pade- 
ties nustatymo svarbq, kuriant atsparias rusis. Siame pa- 
vyzdyje sqvoka efektyvi labai priklauso nuo konteksto. 

3. Savo esme diskutuotini, pavyzdziui: Sugalvokite 
irparenkite naujo maisto produkto koncepcijq. 

Siame pavyzdyje tai, kas laikytina nauju produktu 
labai priklauso nuo subjektyvios nuomones. 

4. Netikslus ar gincytini, pavyzdziui: Pasiulykite la- 
biausiai tinkamq testq duoto produkto aprasui, pagrjs- 
dami savo pasirinkimq studijq dalyko metu jgytais argu- 
mentais ir gauta informacija. 

Siame pavyzdyje sqvoka labiausiai tinkama yra ne- 
tiksli, priklauso nuo konteksto ir gincytina. 

Siekiant, kad asmenys jgytq „nebyliq" zinig, kurios 
reikalingos kompetentingumui palaikyti profesineje ar 
akademineje veikloje, sig skirtingo pobudzio studijg 
rezultatg derinys yra labai svarbus (Eraut, 1 994). Jie yra 
butini pleciant kolektyvines zmonig zinias ir, zinoma, 
gebejimus sias zinias pritaikyti. 

Reiksminga Dublino tyrimo isvada ta, kad kuo 
aukstesnio pazintinio lygmens reikalaujama is stu- 
dentg, tuo abstrakciau turetg buti apibrezti studijg 
rezultatai. 

Taip pat buvo nustatyta, kad studijg rezultatg mo- 
delis akivaizdziai skatina geresnj mokymgsi, nes stu- 
dentai patys gali jsitikinti, kad tai, kg destytojas veike 
auditorijoje bei tai, kaip jie, studentai, buvo vertinami, 
lemia studijg rezultatai. Sis tiesioginis studijg rezultatg, 
studentg pasiekimg vertinimo ir studijg veiklos san- 
tykis vadinamas konstruktyviu derinimu (Biggs, 2003; 
2 pav.). 


1 . Students must demonstrate achievement of ALL 
of the outcomes to gain a pass. 

2. Outcomes can and should define the minimum 
standards necessary to prove possession of a skill, com- 
petency or piece of knowledge. 

These are fallacious assumptions at degree level be- 
cause a part of the purpose of university programmes is 
to ensure that graduates recognise that the knowledge 
and competence that define expertise in any given area 
are always evolving. This is the reason maintaining ex- 
pertise requires lifelong learning (McMahon 2006b). 

The UCD research found that Higher Education 
Programmes need 4 types of outcomes: 

1. Those precise in context and relating to, rela- 
tively, uncontested concepts of skill or knowledge, for 
example: Describe the chemistry and mode of action of 
herbicides and pesticides and the legislation covering 
these substances. 

2. Those relating to concepts, which are, by their 
very nature, imprecise (often because they relate to 
dynamic rather than static situations), for example: 
Describe the role of effective segmentation, targeting and po- 
sitioning in building strong brands. In this example, what con- 
stitutes "effective" is very much context-dependant. 

3. Those, which, again by their very nature, are 
contested, for example: Conceptualize and formulate a 
novel food product. In this example, what constitutes 
"novel" could be very much a matter of opinion. 

4. Those which are both imprecise and contested, 
for example: Suggest the most appropriate test for a giv- 
en product scenario, making choices based on reasoned 
argument using information derived throughout the 
courses In this example, what constitutes"most appro- 
priate" is imprecise, context-related and contestable. 

A combination of all of these different types of out- 
comes is essential if individuals are to develop the tacit 
knowledge necessary to underpin expertise - whether 
professional or academic or both (Eraut 1994). Simi- 
larly, they are all essential to the expansion of collec- 
tive human knowledge and, indeed, to the ability to be 
able to apply that knowledge. 

Significantly, the Dublin study found that the high- 
er the order of cognition being demanded of students, 
the less precise needed to be the wording of the learn- 
ing outcomes. 

It also found that the learning outcomes model 
was much more likely to produce more effective learn- 
ing by students when they could see for themselves 
how what the teacher did in the classroom and the 
way they, as students, were assessed, were determined 
by the outcomes. This direct relationship between 
outcomes, assessment and teaching activities is what 
is meant by constructive alignment (Biggs 2003; See 
Figure 2). 
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2 

GEROSIOS PRAKTIKOS REKOMENDACIJOS 
TOBULINANT IR NAUDOJANT STUDIJy 
REZULTATUS 

Dublino tyrimo rezultatai teikia daug rekomendacijq 
gerajai praktikai kaip aprasyti studijg rezultatus ir jgy- 
vendinti studijg rezultatais pagrjstq studijg turinj. Ze- 
miau pateikiamos 1-5 rekomendacijos susijusios su 
studijg rezultatg aprasymu, o 7-oji ir 8-oji - su jg jgy- 
vendinimu. 6-oji rekomendacija, be abejones, yra visg 
svarbiausia, siejama ir su studijg rezultatg aprasymu, ir 
su jgtaikymu. 

7 rekomendacija. Studijg institucijos turetg uzti- 
krinti galimybq nuolat lankyti studijg turinio tobulinimo 
seminarus, kuriuose nagrinejama, kaip efektyviai aprasyti 
studijg rezultatus. 

Dublino studija atskleide, kad seminarus apie stu- 
dijg rezultatg aprasymg lank^ destytojai sugebejo ko- 
kybiskiau suformuluoti studijg rezultatus, nei destyto- 
jai, kurie tokig seminarg nelanke. Sie seminarai buvo 
ypac naudingi destytojams, aprasiusiems studijg dalykg 
turinio ar procesg atzvilgiu. Seminarus lank$ destytojai 
taip pat gebejo geriau uztikrinti, kad jg destymo ir stu- 
dentg pasiekimg vertinimo metodai deretg su studijg 
rezultatais. Akivaizdu, kad tokio pobudzio seminarg 
nelankiusiems destytojams siq derm^ pasiekti sekesi 
sunkiau. 

1 pav. Esminiai studijg rezultatai ir susij? uzdaviniai 
(smulkesni rezultatai) 

Esminiai rezultatai: 

• Diagnozuoti vezj ir parinkti tinkamg dazniausiai pasitaikancio vezio formos gy- 
dymo budg. 

• Nustatyti, kada ir kokiam specialistui pacientas turi buti nusigstas diagnozei ir 
gydymui. 

Smulkesnieji uzdaviniai: 

- Apibudinkite bendruosius diagnostinius testus piktybinems vezio Igstelems 
nustatyti. 

- Apibudinkite kancerogenezes etapus, specifinius rizikos faktorius ir galimas 
prevencines priemones. 

- Paaiskinkite uzkrestojo vezio liga prevencijos priemones. 

- Isvardykite vezio pozymius. 

- Paaiskinkite vietinius ir sisteminius vezio efektus. 

- Apibudinkite piktybinig navikg invazijos budus, metastazes ir susiekite juos su 
vezio stadija. 

- Apibudinkite gerybinius ir piktybinius navikus ir nurodykite piktybiskumg ska- 
tinancius mechanizmus. 

- Aprasykite atskiras piktybinig navikg grupes, tarp jg odos kiausidzig ir smegeng 
vezj. 

- Aptarkite galimas kiekvienos vezio rusies gydymo priemones, tarp jg radiacijg, 
chemoterapijg ir mitybg. 

- Nustatykite, kada galima pacientg sigsti j kitg gydymo jstaigg. 

- jvertinkite jvairig vezio rusig skirtingas gydymo priemones. 

- Nurodykite, kokiu atveju pacientg reikia sigsti gydytis ir parinkite labiausiai tin- 
kamg laikg. 


2 

GUIDELINES FOR BEST PRACTICE IN 
DEVELOPING AND USING OUTCOMES 

Taken together, the findings of the Dublin study sug- 
gest a number of guidelines for'best practice'in the for- 
mulation of learning outcomes and in the implementa- 
tion of an outcomes-based curriculum. Guidelines 1 - 5 
relate to the formulation of outcomes while guidelines 
7 - 8 relate to implementation. Guideline 6, arguably 
the most important of them all, relates to both. 

Guideline 7: Educational institutions should pro- 
vide regular access to curriculum development workshops 
that explore the issue of writing effective outcomes. 

- In the Dublin study, teachers who attended work- 
shops on how to write learning outcomes tended to 
write better quality outcomes than those who did not. 
Such workshops were particularly beneficial for teachers 
used to describing the curriculum in terms of content 
or processes. Teachers who attended workshops were 
also better able to ensure that their teaching and as- 
sessment methods aligned with their outcomes. Those 
who did not attend such workshops were less likely to 
achieve such alignment. 

Guideline 2: Avoid over-prescription by using large 
global outcomes, the minutiae of which can be filled-out 
with smaller, more detailed objectives that can vary at the 
discretion of the teacher. 

Figure 1 . Global outcomes and associated objectives (smaller outcomes) 

Global Outcomes: 

• Diagnose, and devise appropriate treatment regimes for the most common 
cancers. 

• Identify when, and to whom, referral (for both diagnosis and treatment) is 
appropriate. 

Associated Objectives: 

- Describe common diagnostic tests for malignancy. 

- Describe the stages involved in carcino-genesis, specific risk factors and pos- 
sible preventive measures. 

- Explain host defences against cancer 

- List the warning signs of cancer. 

- Explain the local and systemic effects of cancer. 

- Discuss the spread of malignant tumours by invasion, metastasis and seeding 
and relate them to the staging of cancer. 

- Distinguish between benign and malignant tumours and discuss the mecha- 
nisms leading to malignancy. 

- Describe and differentiate between a range of malignant tumours including 
skin cancer, ovarian cancer, and brain cancer. 

- Discuss possible treatment measures for each of the above, including radiation 
and chemotherapy and nutrition. 

- identify appropriate diagnostic referrals. 

- Evaluate different treatment measures in case studies of different cancers. 

- Identify when referrals for treatment are necessary and select the most appro- 
priate choice available. 
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2 rekomendacija. Venkite pernelyg smulkmenisko 
pagrindinig, esminig studijg rezultatg aprasymo, palikite 
gaiimybq smulkesnes detales suformuluoti kaip studijg uz- 
davinius, kurie galetg skirtis atsizvelgiant j kiekvieno des- 
tytojo studijg proceso konteksto ypatumus. 

Is Dublino studijos matyti, kad moduliai, uztikrin^ 
didziausiq studijq efektyvumo augimq savo studijg da- 
lyko studijg turinio dokumentuose apimdavo pagrindi- 
nius, esminius, stambius studijg rezultatus, o smulkesni 
studijg uzdaviniai (arba mazesnieji studijg rezultatai) 
buvo pasiekiami sudarant sglygas patiems destytojams 
atitinkamu laiku juos paaiskinti studentams studijg da- 
lyko kurso metu. 1 paveiksle pateiktas esminig studijg 
rezultatg ir smulkesnig studijg uzdavinig (mazesnigjg 
studijg rezultatg) skirtumo pavyzdys. 

3 rekomendacija. Naudokite galimai minimalg 
studijg rezultatg skaicig. 

Dublino tyrime destytojai ir studentai nurode at- 
virkstinj rysj tarp studijg dalyko turinio dokumentuose 
isvardytg studijg rezultatg skaiciaus, su kuriais detaliau 
studentai susiduria pirmg kartq studijuodami savo mo- 
duli, ir jq teigiamo poveikio studijoms. Paprastai penkig 
ECTS kreditg apimties moduliui turetg buti formuluoja- 
mi nuo trijg iki sesig studijg rezultatg. 

4 rekomendacija. Visos trys studijg turinio dimen- 
sijos turetg buti tobulinamos tuo paciu metu taikant Biggs 
(2003) konstruktyvaus derinimo modeli. Vienas budg gali buti 
studijg turinio planavimas pagal 2 paveiksle pateiktq formq 
Jaikantis 3 paveikslo kairiame stulpelyje nurodytos sekos. 

Cia aptariamas tyrimas parade, kad svarbiausi stu- 
dijg rezultatais pagrjsto studijg turinio privalumai (darna, 
skaidrumas, padidejusi studentg studijavimo motyvacija, 
geresne studentg darbo kokybe) neisryskeja savaime. Jie 


2 pav. Suderinto studijq turinio planavimo dokumentas 


Studijg rezultatai 

Studijq dalyko pabaigoje 
studentai gebes: 

Studijg pasiekimg 
vertinimas 

Destymo metodas 

N.B. Kiekvienas atskiras studijg rezultatas nebutinai turi buti vertinamas ir mo- 
komas atskirai. Rekomenduojama, kad rezultatai, vertinimas ir destymo metodas 
butg surasomi j stulpelius, kad studijg turinio planuotojai galetg lengviau nusta- 
tyti, kaip kiekvienas rezultatas atspindimas kitame stulpelyje. 


- In the Dublin study, the modules that led to the 
greatest increase in effective learning used global out- 
comes in the curriculum documents and left the de- 
tailed objectives (or smaller outcomes) to be explained 
and addressed by teachers at the appropriate time in 
the course of their studies. Figure 1 presents an example 
of the difference between global outcomes and associ- 
ated objectives (smaller outcomes). 

Guideline 3: Use the minimum possible number of 
outcomes. 

- In the Dublin study, both teachers and students 
reported an inverse relationship between the number 
of outcomes listed in the curriculum documents where- 
in students first encountered details of their module 
and positive impact on learning. As a general rule, the 
number of outcomes for a module worth five ECTS cred- 
its should be between three and six. 

Guideline 4: All three dimension of the curriculum 
should be developed in tandem using Biggs' (2003) model 
of constructive alignment. One way of doing this is to use 
the curriculum planning pro-forma given as Figure 2 us- 
ing the sequence suggested in the left hand column of 
Figure 3. 

- In the Dublin study, it became clear that the main 
expected benefits of an outcomes-based curriculum 
(coherence, transparency, increased student motiva- 
tion, better quality student work) were not inevitable. 
They appeared with far more frequency where teachers 
took the time and trouble to ensure constructive align- 
ment and, having done this, make it obvious to students 
how the learning outcomes determined what they did 


Figure 2. Planning document for an aligned curriculum 


Outcomes 

Assessment 

Teaching Method 

At the end of this course 
students should be able to: 




N.B. This grid is not supposed to imply that each individual learning outcome 
should be assessed or taught separately. It is recommended that outcomes, as- 
sessment and teaching method be described in columns like those above, in order 
that curriculum planners can identify more easily whether each outcome is ad- 
dressed in each of the other columns. It also makes it easier to see when there is a 
mismatch between columns. 


3 pav. Pavyzdine studijg rezultatais pagrjsto studijq turinio planavimo seka ir 
jos palyginimas su tradiciniu planavimo metodu 


Pavyzdine studijg rezultatais pagrjsto 
studijq turinio planavimo seka 

Tradicine planavimo seka 

Studijg rezultatai 

4 

Studijg pasiekimg vertinimas 

4 

Studijg dalyko turinys ir destymo 
metodas 

Studijg turinys 
Destymo metodas 
Studentg pasiekimg vertinimas 
Studijg rezultatai 


Figure 3. Preferred sequence of curriculum development compared to 

traditional planning method 


Preferred Sequence for Planning an 
Outcomes-based curriculum 

Traditional Planning Sequence 

Outcomes 

Assessment 

Content & Teaching Method 

Content 

4 

Teaching Method 

4 

Assessment 

4 

Outcomes 
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daug dazniau atsiskleidzia tuo atveju, kai destytojai nesku- 
bedami megina uztikrinti konstruktyvqderinimqirakivaiz- 
dziai parodo studentams, kaip studijq rezultatus nulemia 
veikla auditorijoje ir studentq egzaminavimo budas.Tose 
auditorijose, kur studentai buvo supazindinti su studijq 
rezultatq aprasymu ir aptare, kq tie rezultatai reiskia ir kaip 
jie gali buti pasiekti, studentq darbo kokybe gerokai padi- 
dejo. Zinoma, studentai savo ruoztu turejo apsispr^sti, ar 
pasinaudoti teikiamomis rekomendacijomis, sudarancio- 
mis prielaidas studijuoti tikslingiau ir efektyviau. 

5 rekomendacija. j studijq rezultatq formulavimq 
ir performulavimq j traukite studentus. 

Dublino tyrimas parade, kad tie destytojai, kurie 
jtrauke savo studentus j studijq rezultatq formulavimo 
ir jvertinimo procesus, pasieke geresniq rezultatq per 
trumpesnj laikq nei tie destytojai, kurie studijq rezulta- 
tus formulavo ir vertino patys, nedalyvaujant studen- 
tams. Studentai buvo jtraukiami jvairiais budais, bet 
patys efektyviausi buvo du: 

(a) velesneje studijq dalyko programos stadijoje 
studentq buvo paprasyta jvertinti rezultatus ir pasiulyti 
pakeitimus studijq rezultatq aprasyme, remiantis jau is- 
eito studijq dalyko kurso dalimi. 

(b) studentq buvo prasoma pakomentuoti modu- 
liuose suformuluotus studijq rezultatus, kuriq jie noretg 
pasiekti kitais programos realizavimo metais. 

Abiem atvejais buvo gauti vertingi duomenys apie 
tai, kaip studentai suvoke studijg rezultatg prasm^ ir 
tiksIq.Tai sglygojo mazesnj zargoninig ir didesnj neutra- 
laus tono sqvokg vartojimg apibudinant studijg rezulta- 
tus. Ir atvirksciai, ten, kur studentai nebuvo jtraukti j stu- 
dijg rezultatg projektavimo ir formulavimo procesq, tie 
studijg rezultatai buvo taip suformuluoti, kad studentai 
juos sunkiai suprato. 

6 rekomendacija. Laikykite studijq rezultatus 
atlikimo rodikliais, kuriais remiasi aukstqjq mokyklq ver- 
tintojai priimdami sprendimus apie studentq galutinio 
pasiekimq lygj. 

Klystume manydami, kad studijg rezultatai auksta- 
jame moksle gali buti galutiniai, kadangi nei kompeten- 
cijos, nei jgudziai aukstesniuose Bloom taksonomijos 
(Anderson et al., 2001) lygmenyse nera laikomi statis- 
kais, nekintanciais pozymiais. Kad ir kokia butg sritis, 
kompetencijas sioje srityje reikia laikyti pletros ir kitimo 
sqvoka, kurig is esmes taip pat suvokia ir specialistai, ir 
ekspertai (Barnett, 1994; Hyland, 1992, 1993; Ashworth, 
Saxton, 1990). Teigti aukstosios mokyklos studentams, 
kad pasiektas meistriskumas yra patikimas ir gali buti 
nekintamas, reiskia daryti jiems meskos paslaugg greitai 
kintancig technologijg pasaulyje.Tai, kas siuo momentu 
yra„geriausioji praktika", visada priklauso nuo konteksto. 
Be to, aprasomojo pobudzio studijg rezultatai gali ne- 
skatinti, netgi kliudyti originalaus mgstymo atsiradimui,, 
kuris butinas zmogaus supratimo pazangai (Wolf, 1 995; 
Barnett, 1 994; Ecclestone, 1 994; Chown, Last 1 993). 


in class and how they would be examined. Where this 
was carried through into the classroom, where stu- 
dents discussed what the outcomes meant and how 
they could be demonstrated, there was a measurable 
increase in the quality of student work. Of course, the 
students, in their turn, had to choose to take advantage 
of this focused guidance to study more strategically and 
effectively. 

Guideline 5: Involve students in the drafting and 
re-drafting of learning outcomes. 

- In the Dublin study, those teachers who involved 
their students in the drafting and evaluation process 
produced better outcomes more quickly that those 
teachers that did not. Students were involved in a va- 
riety of ways but two of the most effective were: 

(a) students in the later stages of a programme 
were asked to evaluate and suggest changes to out- 
comes relating to parts of the course they had already 
completed. 

(b) students were asked to comment on the learn- 
ing outcomes of modules they would be likely to take 
in the next year of their programme. 

In both cases, valuable data was gained on the way 
students were likely to perceive the meaning and pur- 
pose of outcomes. This tended to lead to less jargon-rid- 
den and user-friendlier outcome statements. In contrast, 
where students were not involved in drafting outcomes, 
these were much more likely to be written in a way that 
students found difficult to interpret. 

Guideline 6: Regard outcomes as general per- 
formance indicators that guide the judgement of aca- 
demic assessors rather than as definitive threshold 
statements. 

- The idea that outcomes can be definitive in 
Higher Education is a fallacy because neither compe- 
tence nor proficiency, at the higher levels of Blooms 
taxonomy (Anderson et al 2001), is a static attribute. 
Whatever the field, expertise is a developmental and 
developing concept rooted in the shared understand- 
ing of practitioners and experts (Barnett 1 994, Hyland 
1992, 1993, Ashworth & Saxton 1990). Suggesting to 
students in Higher Education that there are authori- 
tative and fixed definitions of mastery is to do them 
a great disservice in a world of fast-moving techno- 
logical change. What is current'best practice' is always 
context-dependent. Further, prescriptive outcomes 
can actively discourage the very kind of original think- 
ing necessary for advances in human understanding. 
(Wolf 1995, Barnett 1994, Ecclestone 1994, Chown & 
Last 1993). 

Guideline 7: Students should be regularly re- 
minded, as part of the discourse of their studies, of the 
inter-relationship between the intended learning out- 
comes of their programme and what they are expected 
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7 rekomendacija. Studentams studijg dalyko des- 
tymo metu turi bud nuolatprimenama apie sqrysj tarp nu- 
matomg studijg dalyko programos studijg rezultatg ir to, 
ko dkimasi, kad jie padarys ir ismoks dekstudijuodami, dek 
atlikdami verdnimo pradmus arlaikydami egzaminus. 

Tai yra konstruktyvaus studijg turinio derinimo pa- 
vyzdys (4 rekomendacija). Tyrimo rezultatai, sqlygoj^ 
4-osios rekomendacijos suformulavimq, dave atitinka- 
mq pagrindq 7 rekomendacijai. 

8 rekomendacija. Studentams turetg bud jprasta 
tvarka komentuoti gautus studijg dalyko/modulio studijg 
rezultatus ir jg pasiekimo budus. Taciau tai atlikti jie turetg 
bud prasomi po jg pasiekimg verdnimo ir supazindinimo 
su gautais rezultatais. 

Dublino tyrimas parade, kad moduliq jvertinimas 
baigus studijg dalyko kursq duoda daug vertingos infor- 
macijos apie tai, kaip destytojams sekesi pagelbeti stu- 
dentams sutelkti demesj j esminius studijg tikslus. Vienas 
is svarbiausig dalykg- nustatymas, kaip studentai suvoke 
studijg rezultatus ir kaip gebejo sutelkti demesj jiems pa- 
siekti. Daugelis destytojg pabrezdavo, kad, baig^ studijg 
dalyko program^ ir gav$ jvertinimus bei perej^ j kitg stu- 
dijg eta pg, studentai pateike atviresnius ir objektyvesnius 
studijg rezultatg komentarus. Galime kelti prielaidq, kad 
studentai neturedami jsipareigojimg destytojui galejo 
objektyviau ir ramiau jvertinti praeitg etapg. 

ISVADOS 

Dublino studija patvirtino, kad studijg rezultatais pa- 
grjsto metodo taikymas teoriniu poziuriu gali buti nau- 
dingas, nes: 

• Suteikia galimyb^ labiau standartizuoti studijas 
ir sglygoja teisingesnius bei patikimesnius vertinimus; 
kai vertinimo kriterijai isplaukia is suformuluotg studijg 
rezultatg, lengviau palyginti ir pagrjsti sprendimus apie 
tai, kiek ir kokig pazymig reikia parasyti; 

• Sglygoja didesnj skaidrumg, kuris leidzia: 

a) lengviau irtiksliau atlikti palyginimg universiteto 
lygmeniu bei tarptautiniu mastu; 

(b) studentams efektyviau sutelkti demesj pagrindi- 
niams studijg tikslams pasiekti; 

• Uztikrina efektyvesnj studijg dalykg ir modulig 
jvertinimq; gav^s rezultatus, jvertintojas gali nustatyti, 
kaip destymo ir studijavimo strategija, turinys, medzia- 
ga ir kiti saltiniai bei vertinimo procedures padeda stu- 
dentams siekti studijg rezultatg; 

• Garantuoja didesnj studijg dalyko programose ir 
visos studijg programos darnumq; 

• Sglygoja didesnj studento darbo kritiskumq ir 
gilumg. 

Butg klaidinga manyti, kad minetas naudingumas 
pasiekiamas tik rezultatais pagrjstame modelyje. Sis nau- 


to do as students - in terms of both learning activities 
and assessed assignments or examinations. 

- This is the practical application of constructive 
alignment in the curriculum (see guideline 4 above). 
The findings that led to guideline 4, provide an equal 
imperative for guideline 7. 

Guideline 8: As a matter of routine, students 
should be asked to comment on the guidance they re- 
ceived on module outcomes and how to achieve them. 
They should be asked to do this after they have com- 
pleted the related assessment and have been given their 
results. 

- In the Dublin study, post-event evaluation of mod- 
ules provided much valuable information on how suc- 
cessful, or otherwise, teachers were in helping students 
focus on the essential learning goals. One key element 
of this was discovering how well students understood, 
and were able to focus on, the learning outcomes. Many 
teachers reported that students were more open and 
objective in their comments after they had completed 
a module, received their marks and moved on the next 
stage of their studies. It is presumed that this was be- 
cause they no longer felt engaged and could look back 
with greater equanimity. 

CLOSING COMMENTS 

The Dublin study confirmed that the adoption of an 
outcomes-based approach can produce the theoreti- 
cally expected benefits of: 

• greater standardisation leading to fairer and more 
reliable assessment: when assessment criteria follow 
from stated outcomes, decisions on how many marks 
are awarded are much easier to compare and defend. 

• greater transparency leading to 

(a) easier and more accurate inter-university and in- 
ternational comparisons. 

(b) students being able to focus more effectively on 
the key learning goals. 

• more effective evaluation of both modules and 
courses: given the outcomes, an evaluator can estimate 
how well teaching and learning strategies, content, ma- 
terials, other resources and assessment procedures ac- 
tually support students in achieving them. 

• greater coherence in programmes of learning. 

• an increase in the criticality and depth of student 
work. 

These benefits are not, however, inherent or inevi- 
table in the outcomes-based model. Rather they are 
benefits that can accrue if outcomes are used as the 
organising principle of a constructively-aligned curric- 
ulum. The above guidelines, derived from evaluation 
of a large-scale curriculum reform in a major European 
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dingumas gali dideti, jei studijg rezultatai suprantami kaip 
organizacinis konstruktyviai suderinto studijg turinio prin- 
cipas. Ankstesnes rekomendacijos, suformuluotos jver- 
tinus dideles apimties studijg turinio reform^ viename is 
didziausiq Europos universitetg leidzia pasiulyti rekomen- 
dacijas, kaip geriausia aprasyti irtaikyti studijg rezultatus. 

Sis tyrimas atliktas aukstojo mokslo kontekste, t.y. 
apeme destymg ir studijavimg universitetuose. Aukstgjg 
mokyklg destytojai link^ labiau kontroliuoti visus studijg 
turinio aspektus nei jg kolegos kituose svietimo sistemos 
pakopose. Pavyzdziui, jei imtume vertinimq (studijg rezul- 
tatais grindziamoje sistemoje tai testai ar kitos uzduotys, 
parodancios, ar studentai pasieke reikalaujamus studijg 
rezultatus), tai destytojai nustato testavimo tvarkq, pacig 
testg turinj ir veikia kaip vertintojai. Daugeliu atvejg jie 
taip pat organizuoja programg jvertinimg, t. y. renka duo- 
menis ir sprendzia apie tai, kaip veikia jg pacig ar kolegg 
suprojektuota sistema. Tokia galios koncentracija retai 
kur pasitaiko - galbut net neegzistuoja - uz universitetg 
sieng. 

Visa tai rodo, kad anksciau pateiktos rekomendacijos 
bus labai naudingos universitetg akademines bendruo- 
menes nariams, o bendrieji principal turetg buti taikomi 
visais studijg atvejais, kai studijg rezultatai pasitelkiami 
siekiamiems galutiniams rezultatams apibrezti . 
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university, provide guidance on how best to formulate 
and apply outcomes. 

This study was carried out in a higher education 
context - i.e. it involved university-level teaching and 
learning. Teachers in higher education tend to have 
much greater control over all aspects of the curricu- 
lum than do their counterparts who work at other lev- 
els within the education system. For example, when it 
comes to assessment (defined, in an outcomes-based 
system as testing whether students have achieved the 
intended learning outcomes), they design the testing 
regime, set the tests and act as assessors. In many cas- 
es they also conduct evaluations of programmes - i.e. 
they gather data about, and make value judgements 
on, the system that they, or their colleagues, have de- 
signed. This concentration of power is rare - possibly 
even non-existent- outside of universities. 

Consequently, the guidelines given above will be 
of especial and particular use to university academ- 
ics. Nonetheless, the general principles are sound and 
should apply to all educational situations where out- 
comes are used to define the desired end result. 
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